SIGNAL PROCESSING DEVICE, SIGNAL PROCESSING METHOD TO CONTROL A SIGNAL PROCESSING DEVICE, AND COMPUT

专利摘要:
signal processing device, signal processing method for controlling a signal processing device, and program execution processing in a computer. The present technology refers to a signal processing device, a method and a program that allow the acquisition of sound with higher acoustic quality when decoding a sound signal. an envelope information generating unit (24) generates envelope information indicative of an envelope shape for the high frequency components of a sound signal to be encoded. the sine wave information generating unit (26) detects a sine wave signal from the high frequency components of a sound signal, and generates sine wave information indicative of the initial position of the appearance of the sine wave signal. a coded data stream generating unit (27) multiplexes the envelope information, the sine wave information and the low frequency components of the coded sound signal and outputs an acquired coded data stream therefrom. thereby, the receiving side of the encoded data stream can more accurately estimate the high frequency components including the sine wave signal from the envelope information and the sine wave information. the present invention can be applied to a signal processing device.
公开号:BR112013017427B1
申请号:R112013017427-7
申请日:2012-01-06
公开日:2021-06-15
发明作者:Mitsuyuki Hatanaka；Toru Chinen
申请人:Sony Corporation；
IPC主号:

专利说明:

technical field
[001] The present invention relates to a signal processing device, method, and program, and particularly, refers to a signal processing device, program, and method that allows audio to be obtained in a higher audio quality in a case of decoding encoding audio signals. Fundamentals of technique
[002] In general, audio signal coding methods such as HE-AAC (AAC (Advanced Audio Coding) of MPEG (Moving Image Expert Group) 4 High Efficiency ) (international standard ISO / IEC 14496- 3) are known. With such an encoding method, a high frequency encoding technology feature such as SBR (Band Spectral Replication) is used (eg refer to PTL 1).
[003] According to SBR, when encoding audio signals, SBR information is output to generate high-frequency components of the audio signal (hereinafter, referred to as high-frequency signal) along with low-frequency components of the audio signal. encoded audio (hereafter low frequency signal). In the decoding device, while decoding the encoded low-frequency signal, the high-frequency signal is generated using the low-frequency signal obtained by decoding and the SBR information, and thus the audio signal composed of the low-frequency signal and the high frequency signal is obtained.
[004] This type of SBR information includes envelope information mainly representing an envelope shape for the high frequency components, and noise envelope information representing to obtain an added noise signal during the generation of the high frequency components in the device. decoding.
[005] Here, the noise envelope information includes information representing the boundary position for dividing each SBR frame of the noise signal included in the high frequency components into two zones (hereinafter, referred to as the noise boundary position) , and information representing noise signal gain in each zone. Therefore, in the decoding device, a gain adjustment is made in each zone divided by the noise boundary position in a predetermined noise signal based on the noise envelope information to establish a final noise signal. Furthermore, with SBR, it is also possible to set the gain on the entire SBR frame without splitting the SBR frame of the noise signal into two zones.
[006] When decoding the audio signal, the decoding device generates the high-frequency components by combining a high-frequency pseudo signal obtained from the low-frequency signal and the envelope information, and the noise signal obtained from the information of noise envelope, and generates the audio signal from the obtained high-frequency components and the low-frequency signal.
[007] Furthermore, with SBR, an encoding using sine wave synthesis is performed on an audio signal with a high pitch characteristic. That is, when generating the high frequency components on the decoding side, a sine wave signal of a particular frequency is added to the high frequency pseudo signal in addition to the noise signal. In this case, the signal obtained from the combination of the high frequency pseudo signal, the noise signal, and the sine wave signal is set to the high frequency signal obtained as a prediction.
[008] When using a sine wave signal to predict the high frequency components, a sine wave information representing the existence/non-existence of the sine wave signal in the SBR frame is included in the SBR information. Specifically, the sine wave signal combination start position used during decoding is either the SBR frame start position or the noise boundary position, and the sine wave information is composed of binary information representing the existence/non-existence of a combination of sine wave signal in each zone of the SBR frame divided by the noise boundary position.
[009] In this way, the noise signal and the sine wave signal added to the high frequency pseudo signal are components that are difficult to reproduce from the envelope information within the high frequency components of the source audio signal. Therefore, by combining the noise signal and the sine wave signal at a suitable position in the high frequency pseudo signal, it is possible to predict the high frequency components more accurately, and it is possible to reproduce audio in a higher audio quality by performing high frequency expansion. passband using the high frequency components obtained by prognostication.List of Citations Patent Literature PTL 1: Unexamined Japanese Patent Application Publication (PCT Application Translation) No. 2001-521648 Summary of the inventionTechnical problem
[0010] However, when using the sine wave signal to predict the high frequency components, the combination start position of the sine wave signal is set as the start position of the SBR frame or the noise boundary position, which can cause variance in the initial position of emergence of the sine wave components in the original audio signal in some cases. Therefore, it is not possible to reproduce the high frequency components with high precision, and it may cause degradation in the audible perception of the audio signal obtained from the decoding.
[0011] Particularly with SBR, the frame length is fixed and not dependent on the sampling rate of the audio signal to be encoded, and so when the sampling rate is low, the absolute time length for a frame becomes longer . For this reason, the amount of variance (difference) in absolute time between the initial position of emergence of the sine wave components in the source audio signal and the initial position of combination of the sine wave signal to be combined during decoding increases, and quantization noise becomes noticeable in these variance zones.
[0012] The present technology was made taking this type of situation into consideration to allow obtaining audio at a higher audio quality when decoding audio signals. Solution to problem
[0013] A signal processing device of a first aspect of the present invention is provided with an extraction unit configured to extract an envelope information representing low frequency components of an audio signal and an envelope of high frequency components of the signal audio and the sine wave information used to identify the frequency and emersion position of the sine wave components included in the high frequency components, a high frequency pseudo-generating unit configured to generate a high-frequency pseudo-signal by configuring the high-frequency components based on the low frequency signal as the low frequency component and the envelope information, a sine wave generating unit configured to generate a sine wave signal at a frequency represented by the sine wave information and designating the emersion position identified from the sine wave information as the position. the initial, and the combining unit configured to combine the low frequency signal, the high frequency pseudo signal, and the sine wave signal to generate the audio signal.
[0014] The sine wave information may include information representing the distance from the start position of a frame of the high frequency component to the start position of emersion of the sine wave component as information used to identify the emersion position.
[0015] The signal processing device is further provided with a noise generating unit configured to generate a noise signal by configuring the high frequency components by adjusting the gain of each zone of a predetermined signal, in which the zones are divided by the noise boundary position represented by the noise envelope information, based on the information representing the gain of each zone represented by the noise envelope information, characterized by the fact that the extraction unit still extracts the noise envelope information , the sine wave information includes information representing the distance from the noise boundary position to the initial emersion position of the sine wave components as the information used to identify the emersion position, and the combining unit can combine the signal frequency, the high frequency pseudo signal, the sine wave signal, and the noise signal to generate the audio signal. O.
[0016] The sine wave information may include information representing the distance from a peak position of the envelope of the high frequency component to the initial emersion position of the sine wave component as the information used to identify the emersion position.
[0017] The sine wave information can be extracted for each frame, and the sine wave generating unit can generate the sine wave signal for the high frequency components of each frame.
[0018] The sine wave information can be extracted for each band by configuring the high frequency components, and the sine wave generation unit can generate the sine wave signal for each band.
[0019] A signal or program processing method of the first aspect of the present invention includes the steps of extracting the low frequency components of the audio signal, the envelope information representing the envelope of the high frequency component of the audio signal, and the sine wave information used to identify the frequency and initial position of emersion of the sine wave component included in the high frequency components, generate the high frequency pseudo signal by configuring the high frequency components on the bases of a low frequency signal as the component low frequency and envelope information, generate a sine wave signal at the frequency represented by the sine wave information at a home position identified by the emerging home position from the sine wave information, and combine the low frequency signal, the high frequency pseudo signal, and the sine wave signal to generate the audio signal.
[0020] Considering the first aspect of the present invention, the envelope information representing low frequency components of an audio signal and an envelope of high frequency components of the audio signal and sine wave information used to identify the frequency and position of emergence of the sine wave components included in the high frequency components is extracted, a high frequency pseudo signal configuring the high frequency components is generated based on the low frequency signal as the low frequency components and the envelope information, a signal of sine wave at a frequency represented by the sine wave information and designating the emerging position identified from the sine wave information as the start position is generated, and the low frequency signal, the high frequency pseudo signal, and the sine wave are combined to generate the audio signal.
[0021] A signal processing device of a second aspect of the present invention is provided with an envelope information generating unit configured to generate envelope information representing an envelope of a high frequency signal, which is the high frequency component of an audio signal, the sine wave information generating unit configured to detect a sine wave signal included in the high frequency signal, and generate a sine wave information used to identify the frequency and position of emerging wave signal. sine wave, and an output unit configured to generate and output data created from a low frequency signal, which is a low frequency component of the audio signal, envelope information, and sine wave information.
[0022] The sine wave information may include information representing the distance from the home position of a frame of the high frequency component to the emersion home position of the sine wave signal as information used to identify the emersion position.
[0023] The signal processing device is further provided with a noise envelope information generation unit configured to detect a noise signal included in the high frequency signal, and generate a noise envelope information made from the information representing a noise boundary position that divides the noise signal into multiple zones and information representing the gain of the noise signal in the zone, wherein the sine wave information includes information representing the distance from the noise boundary position to the initial position of emersion of the sine wave components as the information used to identify the emersion position, and the output unit can generate and output data created from the low frequency signal, the envelope information, the sine wave information, and the noise envelope information.
[0024] The sine wave information may include information representing the distance from a peak position of the envelope of the high frequency component to the initial emersion position of the sine wave component as the information used to identify the emersion position.
[0025] Sine wave information can be generated for each frame.
[0026] Sine wave information can be generated for each band by configuring the high frequency components.
[0027] A signal or program processing method of the second aspect of the present invention includes the steps of generating envelope information representing an envelope of a high frequency signal, which is the high frequency component of an audio signal, generating information of the sine wave included in the high frequency signal is detected, and the sine wave information used to identify the frequency and emersion position of the sine wave signal, and generate and output data created from a low frequency signal, which is the low frequency component of the audio signal, the envelope information, and the sine wave information.
[0028] Considering the second aspect of the present invention, envelope information representing an envelope of a high frequency signal, which is a high frequency component of an audio signal, is generated, a sine wave signal included in the high signal frequency is detected, and a sine wave information used to identify the frequency and emersion position of the sine wave signal is generated, and data created from a low frequency signal, which is a low frequency component of the audio signal. , envelope information, and sine wave information are generated and output. Advantageous Effects of the Invention
[0029] According to the first aspect and the second aspect of the present technology, audio can be obtained in a higher audio quality when decoding an audio signal. Brief Description of Drawings
[0030] [Fig. 1] Fig. 1 is a diagram illustrating an example of configuration of a first embodiment of an encoding device.
[0031] [Fig. 2] Fig. 2 is a flowchart describing encoding processing.
[0032] [Fig. 3] Fig. 3 is a diagram illustrating a combination start position of a sine wave signal.
[0033] [Fig. 4] Fig. 4 is a diagram illustrating a combination start position of a sine wave signal.
[0034] [Fig. 5] Fig. 5 is a diagram illustrating an example of configuration of the first mode of a decoding device.
[0035] [Fig. 6] Fig. 6 is a flowchart describing a decoding process.
[0036] [Fig. 7] Fig. 7 is a flowchart describing a process for generating the sine wave signal.
[0037] [Fig. 8] Fig. 8 is a diagram illustrating a configuration example of another encoding device.
[0038] [Fig. 9] Fig. 9 is a flowchart describing encoding processing.
[0039] [Fig. 10] Fig. 10 is a diagram describing a combination start position of the sine wave signal.
[0040] [Fig. 11] Fig. 11 is a diagram illustrating an example configuration of another decoding device.
[0041] [Fig. 12] Fig. 12 is a flowchart describing decoding processing.
[0042] [Fig. 13] Fig. 13 is a flowchart describing a process for generating the sine wave signal.
[0043] [Fig. 14] Fig. 14 is a diagram illustrating the configuration example of another encoding device.
[0044] [Fig. 15] Fig. 15 is a flowchart describing an encoding processing.
[0045] [Fig. 16] Fig. 16 is a diagram describing a combination start position of the sine wave signal.
[0046] [Fig. 17] Fig. 17 is a diagram illustrating an example configuration of another decoding device.
[0047] [Fig. 18] Fig. 18 is a flowchart describing a decoding process.
[0048] [Fig. 19] Fig. 19 is a flowchart describing a process for generating the sine wave signal.
[0049] [Fig. 20] Fig. 20 is a diagram illustrating an example of configuration of another encoding device.
[0050] [Fig. 21] Fig. 21 is a flowchart describing an encoding processing.
[0051] [Fig. 22] Fig. 22 is a diagram illustrating an example configuration of another decoding device.
[0052] [Fig. 23] Fig. 23 is a flowchart describing a decoding process.
[0053] [Fig. 24] Fig. 24 is a flowchart describing a process for generating the sine wave signal.
[0054] [Fig. 25] Fig. 25 is a diagram illustrating an example of a computer configuration. Description of Modalities
[0055] Hereinafter, the modalities applying the present technology will be described with reference to the drawings.<First modality>[Example of Encoding Device Configuration]
[0056] Fig. 1 is a diagram illustrating an example of configuration of a first modality of an encoding device applying the present technology.
[0057] An encoding device 11 is configured with a down sampling device 21, a low frequency encoding unit 22, a bandpass division filter 23, an envelope information generating unit 24, a unit a noise envelope information generating unit 25, a sine wave information generating unit 26, and an encoding data stream generating unit 27. The encoding device 11 encodes and outputs an input audio signal, and the audio signal input to the encoding device 11 is supplied to the downsampling device 21 and to the bandpass division filter 23.
[0058] The down-sampling device 21 extracts the low-frequency signal, which is the low-frequency component of the audio signal, down-sampling the input audio signal, and supplies it to the low-frequency encoding unit. frequency 22 and to the noise envelope information generating unit 25. Furthermore, hereinafter, the frequency band components at or below a certain frequency of the audio signal are referred to as the low frequency components, and frequency band components larger than the low frequency components of the audio signal are referred to as the high frequency components.
[0059] The low frequency encoding unit 22 encodes the low frequency signal provided from the down sampling device 21, and supplies it to the encoding data stream generating unit 27.
[0060] The bandpass division filter 23 conducts filter processing on the input audio signal, and performs bandpass division on the audio signal. As a result of this bandpass splitting, the audio signal is split into a multiband component signal. Furthermore, hereinafter, each band signal configuring the high frequency components from within each band signal obtained by bandpass division is referred to as the high frequency signal. The bandpass division filter 23 supplies the high frequency signal from the high frequency side of each band obtained by bandpass division to the envelope information generation unit 24, to the envelope information generation unit of noise 25, and to the sine wave information generating unit 26.
[0061] The envelope information generation unit 24 generates an envelope information representing a shape of an envelope (envelope) for the high frequency band signal for each band on the high frequency side based on the provided high frequency signal from the bandpass division filter 23, and then supplies it to the noise envelope information generation unit 25. In addition, the envelope information generation unit 24 is provided with an encoding unit 41, and the encoding unit 41 encodes the envelope information generated by the envelope information generating unit 24, and supplies it to the encoding data stream generating unit 27.
[0062] The noise envelope information generation unit 25 generates a noise envelope information while receiving information from the sine wave information generation unit 26 as required, based on the high frequency signal from the filter of bandpass division 23 and the envelope information from the envelope information generation unit 24.
[0063] Here, the noise envelope information is information made from information representing a boundary position (noise boundary position) for dividing the noise signal included into the high frequency components of the audio signal, and information representing the noise signal gain for each zone divided into the noise boundary position. Furthermore, the noise signal is a previously determined signal.
[0064] Furthermore, the noise envelope information generation unit 25 is provided with a signal generation unit 51, a border calculation unit 52, and an encoding unit 53. When generating noise envelope information , the signal generating unit 51 predicts the high frequency side of the audio signal for each band component based on the low frequency signal from the down sampling device 21 and the envelope information from the generating unit of envelope information 24.
[0065] The boundary calculation unit 52 determines the noise boundary position used to divide the noise signal into multiple zones based on the envelope of the noise signal obtained from the high frequency signal and a high frequency pseudo signal, which is the result of the high frequency side of each passband component predicted when generating a noise envelope information. The encoding unit 53 encodes the noise envelope information generated by the noise envelope information generating unit 25, and supplies it to the encoding data stream generating unit 27.
[0066] The sine wave information generating unit 26 generates sine wave information used to obtain the sine wave signal included in the band for each band on the high frequency side while receiving the information from the envelope information generating unit of noise 25 as needed, based on the high frequency signal supplied from the bandpass division filter 23.
[0067] Here, the sine wave information is information made from the information representing the existence/non-existence of a sine wave signal included in the high frequency components of the audio signal, and the information used to identify the initial position of sine wave signal emergence. That is, sine wave information can be information made from information representing the existence / non-existence of a sine wave signal to be combined with the high frequency pseudocomponents during decoding of the audio signal, and information representing the initial position combination of sine wave signal.
[0068] Furthermore, then sine wave information generating unit 26 is provided with a sine wave detection unit 61, a position detection unit 62, and an encoding unit 63. The sine wave detection unit 61 detects the existence / non-existence of the sine wave components from the high frequency signal during generation of the sine wave information.
[0069] When generating sine wave information, the position detection unit 62 detects the combination start position indicating where the combination of the sine wave signal should start, that is, the start position of emerging sine wave signal, with base on the high frequency signal from the bandpass division filter 23. The encoding unit 63 encodes the sine wave information generated by the sine wave information generating unit 26, and supplies it to the stream generating unit of encoding data 27.
[0070] The encoding data stream generating unit 27 encodes the low frequency signal from the low frequency encoding unit 22, the envelope information from the envelope information generating unit 24, the information of the noise envelope from the noise envelope information generating unit 25, and the sine wave information from the sine wave information generating unit 26, and outputs the encoding data stream obtained from this encoding . That is, the low frequency signal, the envelope information, the noise envelope information, and the sine wave information are multiplexed into the encoding data stream. [Description of Encoding Processing]
[0071] Next, the operation of the encoding device 11 will be described.
[0072] When the audio signal is input to the encoding device 11, and instructed to encode the audio signal, the encoding device 11 performs encoding processing to effect encoding the audio signal, and outputs the data stream coding obtained as the result. Hereinafter, the encoding processing by the encoding device 11 will be described with reference to the flowchart in Fig. 2.
[0073] In a step S11, the down sampling device 21 down samples the input audio signal to generate the low frequency signal, and supplies it to the noise envelope information generating unit 25 and to the low frequency encoding unit 22.
[0074] In a step S12, the low frequency encoding unit 22 encodes the low frequency signal provided from the down sampling device 21, and supplies it to the encoding data stream generating unit 27. For example, the low frequency signal is encoded by an encoding method such as MPEG4 AAC, MPEG2 AAC, CELP (Code Exited Linear Prediction), TCX (Transform Coded Excitation), or AMR (Adaptive Multi-Rate).
[0075] In a step S13, the bandpass division filter 23 divides the input audio signal into bands, and the high frequency components obtained as the result are supplied to the envelope information generation unit 24 through the sine wave information generating unit 26. For example, high frequency signals can be obtained as high frequency components from 64 different bands.
[0076] In a step S14, the envelope information generation unit 24 generates the envelope information for each band based on the high frequency signal for each band provided from the bandpass division filter 23. For example, the envelope information generating unit 24 can designate a zone composed of 32 samples of the high frequency signal as a frame, and generate the envelope information for each band per frame.
[0077] Specifically, the envelope information generation unit 24 obtains an average sample value of two samples of the close high frequency signal on a timeline in one frame, and this average value becomes the new sample value of high frequency signal. As a result, the high frequency signal for one frame is converted from a 32-sample signal to a 16-sample signal.
[0078] Next, the envelope information generation unit 24 performs a difference encoding on the high frequency signal which is now 16 samples, and the information obtained as the result becomes the envelope information. For example, the difference between the sample value of two high-frequency signal samples to be processed close together on a timeline is obtained by difference encoding, and this difference becomes the envelope information. Furthermore, the envelope information can be composed of the difference between the sample value of a sample of the high frequency signal of the band to be processed and the sample value of a sample in a band adjacent to that band, in the same position as the bunch of the high frequency signal, for example.
[0079] The envelope information obtained in this way is the information representing the shape of the envelope for a frame of the high frequency signal. The encoding unit 41 performs variable-length encoding such as Huffman encoding on the generated envelope information, and supplies the encoded envelope information to the encoding data stream generating unit 27. envelope information 24 supplies the envelope information to the noise envelope information generation unit 25.
[0080] Furthermore, henceforth, the high frequency signal will continue to be described as that processed in units of a configured 32-sample frame. Also, henceforth, the zone configured from two samples of the high frequency signal (audio signal) will be called a time interval.
[0081] In a step S15, the signal generating unit 51 in the noise envelope information generating unit 25 generates the high frequency pseudo signal for each band on the high frequency side based on the envelope information provided from the envelope information generating unit 24 and the low frequency signal provided from the down sampling device 21.
[0082] For example, the signal generating unit 51 extracts the zone for a frame of a predetermined band of the low frequency signal, and manipulates the extracted low frequency signal in the envelope form represented by the envelope information. That is, the sample value of the sample of the low frequency signal is increased or decreased such that a position gain corresponding to the sample fits into the envelope represented by the envelope information, and the signal obtained as the result becomes the pseudo high signal. frequency.
[0083] The pseudo high frequency signal obtained in this way has almost the same envelope shape as the envelope of the effective high frequency signal represented by the envelope information. That is, the high frequency pseudo signal is generated from the low frequency signal and envelope information.
[0084] In a step S16, the noise envelope information generation unit 25 extracts the difference between the high frequency signal and the high frequency pseudo signal for each band on the high frequency side, and obtains the envelope for the signal noise (hereafter referred to as the noise envelope).
[0085] Furthermore, more specifically, the noise envelope obtained in step S16 is a virtual noise envelope. The receiving side of the encoding data stream emitted from the encoding device 11 predicts the high frequency components of the audio signal during decoding of the audio signal, but this prediction is performed by combining the high frequency pseudo signal, the noise signal, and the sine wave signal.
[0086] That is, the high frequency components of the effective audio signal are assumed to include the high frequency pseudo signal, the noise signal, and the sine wave signal. Here, in step S16, the difference between the high frequency signal and the high frequency pseudo signal is obtained, and this difference must be the combination of the noise signal and the sine wave signal. Therefore, the difference obtained in this way is considered as the envelope of the noise signal including the sine wave signal.
[0087] The noise envelope information generation unit 25 supplies the virtual noise envelope for each band on the high frequency side obtained as previously described for the sine wave information generation unit 26.
[0088] In a step S17, the sine wave detection unit 61 in the sine wave information generating unit 26 detects the sine wave components from the high frequency signal for each band based on the provided virtual noise envelope from the noise envelope information generation unit 25.
[0089] For example, the sine wave detection unit 61 conducts a frequency conversion into the virtual noise envelope, and converts the noise envelope into the frequency components. Then, when there are frequency peaks having high power in the obtained frequency components, the sine wave detection unit 61 recognizes these frequency components as the sine wave components. Specifically, when the difference between the power of the frequency under observation and the power of other frequencies in the surroundings is at or above a predetermined threshold, the frequency under observation is recognized as the sine wave component. The sine wave signal for the frequency detected in this way is determined as the sine wave signal included in the effective high frequency components.
[0090] In a step S18, the position detection unit 62 in the sine wave information generating unit 26 detects, for each band, the combination initial position where the sine wave signal, which is the sine wave component detected, must be combined based on the high frequency signal supplied from the bandpass division filter 23.
[0091] For example, the position detection unit 62 obtains the difference between the average sample value of the samples included in a time interval of the high frequency signal, in time interval units, and the average sample value of samples included in a time range of the detected sine wave signal. Then, the position detection unit 62 determines a combination start position by looking from the beginning of the zone to a frame as the end position (start position of the time interval or the end position of the sample) where the obtained difference value is at or above a predetermined threshold. This combination start position is the sine wave signal emerging start position included in the effective high frequency signals, from a time after the combination start position, the difference in the average sample values of the high frequency signal and the sine wave signal should decrease.
[0092] In addition, for each band on the high frequency side, the sine wave information generation unit 26 supplies the information representing whether or not the sine wave was detected from the bands, the information representing the frequency and power of the detected sine wave signal, and the combination start position for the noise envelope information generation unit 25.
[0093] In a step S19, the sine wave information generation unit 26 generates the sine wave information for each band on the high frequency side, and supplies it to the encoding data stream generation unit 27.
[0094] For example, the sine wave information generating unit 26 designates the information made from the information representing whether or not the sine wave signal was detected from the high frequency band and the initial combination position as the sine wave information. Furthermore, during the generation of the sine wave information, the coding unit 63 in the sine wave information generation unit 26 performs variable length coding of the information representing the combination start position.
[0095] Here, information representing whether or not the sine wave signal has been detected is, more specifically, information representing which frequency in the high frequency band is the sine wave component. For example, when multiple sine wave signals are detected from the high frequency band, the information used to identify the frequencies of those sine wave signals is designated as the information representing whether or not the sine wave signals were detected. Furthermore, when multiple sine wave signals are detected from the high frequency band, information representing the combination start position is generated for each sine wave signal.
[0096] Furthermore, when the sine wave component is not detected from the high frequency band, the sine wave information composed only of information representing whether the sine wave signal was the one detected is transmitted to the decoding side. That is, sine wave information not including information representing the combination start position is transmitted.
[0097] Furthermore, the encoding device 11 can select whether or not to transmit the sine wave information to the per-frame decoding side. In this way, by enabling the transmission of selectable sine wave information, transfer efficiency of the encoding data stream is increased, and at the same time, a reconfiguration of the timing information of the sine wave components can be performed. As a result, when starting decoding processing from an arbitrary frame within the data stream on the decoding side of the encoding data stream, the sine wave component from the frame including the information representing the combination start position can be started.
[0098] Furthermore, as illustrated in Fig. 3, for example, the combination start position on the decoding side conventionally was either the frame start position or the noise boundary position. Also, the horizontal axis in the figure represents the timeline. Furthermore, an arrow FS1 and an arrow FE1 in Fig. 3 represent the starting position and the ending position of the frame, respectively.
[0099] According to the example in Fig. 3, the position represented by an arrow N1 is the noise boundary position, and the initial position of combination of the sine wave signal is also in the same position as the boundary position of the noise. Therefore, the sine wave signal is combined into a zone from the position represented by arrow N1 to the final frame position.
[00100] However, when the position where the sine wave signal included in the effective high-frequency components arrives is after the noise boundary position represented by the arrow N1, for example, on the decoding side, unnecessary sine wave components are added in space from the noise boundary position to the initial position of emergence of the effective sine wave signal. In this case, there is an unpleasant audible sensation in the audio signal obtained by decoding, and audio at a high audio quality is unable to be obtained.
[00101] Considering this, as illustrated in Fig. 4, according to the encoding device 11, the initial position of combination output to the decoding side is not limited to be the same as the noise boundary position. Also, the horizontal axis in the figure represents the timeline. Furthermore, an arrow FS2 and arrow FE2 in Fig. 4 represent the starting position and the ending position of the frame, respectively.
[00102] According to the example in Fig. 4, the position represented by an N2 arrow represents the noise boundary position. In addition, the combination start position of the sine wave signal is the position represented by an arrow G1, and this combination start position is before the noise boundary position. According to this example, the sine wave signal is combined in the zone from the start position of the combination represented by the arrow G1 to the end position of the frame.
[00103] Furthermore, in this case, the information representing the length of time (time distance) from the frame start position represented by the arrow FS2 to the combination start position represented by the arrow G1 is designated as the information representing the position initial combination. Here, the time from the beginning of the frame to the start position of the blend is an integral multiple of the length of the time interval.
[00104] In this way, by specifying the initial combination position independent of the noise boundary position, the combination of unnecessary signals is avoided during the decoding of the audio signal, and audio in a higher audio quality can be obtained.
[00105] In addition, the sine wave information was previously described as generated information representing the combination start position for the high frequency side for each band, but the sine wave information can use a representative value of the combination start positions for these shared bands for each band setting the high frequency. In such a case, for example, the information representing the combination start position for the band outside the multiple bands configuring the high frequency having the highest power sine wave signal becomes the sine wave information.
[00106] In addition, the information representing the combination start position was described above as the sine wave information for which variable length encoding was performed, but the information representing the combination start position may not be encoded.
[00107] Returning to the flowchart description in Fig. 2, in step S19, the sine wave information is generated, and then processing proceeds to step S20,
[00108] In a step S20, the boundary calculation unit 52 in the noise envelope information generation unit 25 detects the noise boundary position for each band on the high frequency side.
[00109] For example, the boundary calculation unit 52 generates the sine wave information included in the frame for the band setting the high frequency based on the information representing whether the sine wave signal was detected or not, the information representing the frequency and sine wave signal strength, and the combination start position. For example, when the sine wave signal is detected, the zone from the beginning of the frame to the combination start position is designated as a silent zone, and the zone from this point is composed of the sine wave component of a pre-determined the amplitude of the detected frequency. At this time, the amplitude of the sine wave signal is determined from the information representing the power of the sine wave signal supplied from the sine wave information generating unit 26. Furthermore, when the sine wave signal is not detected , the amplitude of the sine wave signal is set to zero.
[00110] Next, the boundary calculation unit 52 subtracts the sine wave signal obtained in this way from the virtual noise envelope obtained in a step S16 to obtain the final noise envelope. Then, the boundary calculation unit 52 determines the noise boundary position according to the final noise envelope gain distribution.
[00111] That is, the boundary calculation unit 52 divides the frame into two zones as needed based on the final noise envelope gain distribution. Specifically, when the noise envelope gain is almost the same value for the entire frame of the band being processed, frame division is not performed. I mean, there is no noise boundary position.
[00112] Furthermore, when there is a large difference in the gain distribution of the noise envelope at a predetermined position in the frame for the zone before this position and the zone after this position, this position becomes the noise boundary position. . In addition, the noise boundary position is designated as the time slot boundary position.
[00113] In a step S21, the noise envelope information generation unit 25 generates the noise envelope information for each band on the high frequency side, and supplies it to the encoding data stream generation unit 27 .
[00114] For example, the noise envelope information generating unit 25 designates the noise envelope information as the information made from the noise boundary position, and the noise signal gain in each zone in the split frame by this noise boundary position. At this time, the encoding unit 53 performs encoding of the information representing the noise boundary position, and variable-length encoding of the information representing the gain for each divided zone.
[00115] Here, the gain for each split zone is the average gain value of the noise envelope in those zones, for example. That is, the frame being processed is divided into two zones by the noise boundary position. In this case, the gain for the zone from the beginning of the frame to the noise boundary position is the average gain value for each position of the final noise envelope in this zone.
[00116] In a step S22, the encoding data stream generating unit 27 encodes the low-frequency signal from the low-frequency encoding unit 22, the envelope information from the information generating unit. envelope 24, the noise envelope information from the noise envelope information generating unit 25, and the sine wave information from the sine wave information generating unit 26, and generates the encoding data stream . Then, the encoding data stream generating unit 27 transmits the encoding data stream obtained from encoding to the decoding device, etc., and encoding processing ends.
[00117] In this way, the encoding device 11 generates and outputs the encoding data stream made from the low frequency signal, the envelope information, the noise envelope information, and the sine wave information. At this time, through a more accurate sine wave signal combination home position being detected, and generating the sine wave information including this combination home position, a more accurate sine wave signal combination can be performed on the decoding side. of the audio signal, which results in obtaining audio at a higher audio quality.
[00118] In addition, the low frequency signal generated by the down sampling device 21 was described above to be provided to the noise envelope information generation unit 25, but the low frequency signal provided to the generation unit of noise envelope information 25 can be a low frequency signal obtained by dividing the bands by the bandpass dividing filter 23. In addition, the low frequency signal encoded by the low frequency encoding unit 22 is obtained by decoding, but this can also be provided to the noise envelope information generation unit 25.[Decoding Device Configuration Example]
[00119] Next, a decoding device that receives the encoding data stream outputs from the encoding device 11 in Fig. 1, and obtains the audio signal from the encoding data stream will be described. This type of decoding device is configured as illustrated in Fig. 5, for example.
[00120] A decoding device 91 in Fig. 5 is configured with an encoding data stream decoding unit 101, a low frequency decoding unit 102, an envelope information decoding unit 103, a decoding unit envelope information device 104, a sine wave information decoding unit 105, and a bandpass combination filter 106.
[00121] The encoding data stream decoding unit 101 receives and decodes the encoding data stream transmitted from the encoding device 11. That is, the encoding data stream decoding unit 101 inversely multiplexes the stream of encoding data, and the low-frequency signal, the envelope information, the noise envelope information, and the sine wave information obtained as a result is provided to the low-frequency decoding unit 102, to the coding unit. envelope information decoding 103, to the noise envelope information decoding unit 104, and to the sine wave information decoding unit 105, respectively.
[00122] The low frequency decoding unit 102 decodes the low frequency signal provided from the encoding data stream decoding unit 101, and supplies it to the envelope information decoding unit 103 and to the filter. bandpass combination 106.
[00123] The envelope information decoding unit 103 decodes the envelope information provided from the encoding data stream decoding unit 101, and also supplies the decoded envelope information to the sine wave information decoding unit 105. Furthermore, the envelope information decoding unit 103 is provided with the generating unit 121, and the generating unit 121 generates envelope information and the high frequency pseudo signal based on the low frequency signal from the unit of low frequency decoding 102, and supplies it to bandpass combination filter 106.
[00124] The noise envelope information decoding unit 104 decodes the noise envelope information provided from the encoding data stream decoding unit 101. In addition, the noise envelope information decoding unit 104 is provided with a generation unit 131, and the generation unit 131 generates the noise signal based on the noise envelope information, and supplies it to the bandpass combination filter 106.
[00125] The sine wave information decoding unit 105 decodes the sine wave information provided from the encoding data stream decoding unit 101. In addition, the sine wave information decoding unit 105 is provided with a generation unit 141, and the generation unit 141 generates the sine wave signal on the basis of the sine wave information and envelope information from the envelope information decoding unit 103, and supplies it to the combination filter. pass band 106.
[00126] The bandpass combination filter 106 combines the bands of the low-frequency signal from the low-frequency decoding unit 102, the high-frequency pseudo signal from the envelope information decoding unit 103, the signal of noise from the noise envelope information decoding unit 104, and the sine wave signal from the sine wave information decoding unit 105 to generate the audio signal. The bandpass combination filter 106 outputs the signal obtained from the combination of bands as the decoded audio signal to a down stream execution unit or the like.[Decoding Processing Description]
[00127] When the encoding data stream from the encoding device 11 is transmitted to the decoding device 91 illustrated in Fig. 5, the decoding device 91 performs the decoding processing in frame units to decode the signal. audio. Hereinafter, the decoding processing performed by the decoding device 91 will be described with reference to Fig. 6.
[00128] In a step 51, the encoding data stream decoding unit 101 decodes the encoding data stream received from the encoding device 11, and supplies the low frequency signal, envelope information, envelope information of the noise, and sine wave information obtained as a result to the low frequency decoding unit 102 through the sine wave information decoding unit 105.
[00129] In a step S52, the low-frequency decoding unit 102 decodes the low-frequency signal from the encoding data stream decoding unit 101, and supplies it to the envelope information decoding unit 103 and for bandpass combination filter 106.
[00130] In a step S53, the envelope information decoding unit 103 decodes the envelope information from the encoding data stream decoding unit 101. In addition, the envelope information decoding unit 103 supplies the envelope information decoded to the sine wave information decoding unit 105.
[00131] In a step S54, the generation unit 121 in the envelope information decoding unit 103 generates the high frequency pseudo signal for each band on the high frequency side, based on the low frequency signal from the decoding unit of low frequency 102, and supplies it to the bandpass combination filter 106. For example, the generating unit 121 generates the high frequency pseudo signal by extracting the zone for a frame considering a predetermined band of the low frequency signal, and increasing or decreasing the low frequency signal such that the sample value of the extracted low frequency signal sample matches the gain of the position in the envelope represented by the envelope information corresponding to that sample.
[00132] In a step S55, the noise envelope information decoding unit 104 decodes the noise envelope information from the encoding data stream decoding unit 101.
[00133] In a step S56, the generating unit 131 in the noise envelope information decoding unit 104 generates the noise signal for each band on the high frequency side, based on the noise envelope information, and supplies it. to the bandpass combination filter 106. That is, the generating unit 131 generates the noise signal by adjusting the gain for each zone of a predetermined signal that has been zoned by the noise boundary position represented by the information of noise envelope such that the gain of this signal matches the gain represented by the noise envelope information.
[00134] In a step S57, the sine wave information decoding unit 105 decodes the sine wave information from the encoding data stream decoding unit 101. For example, the information representing the combination start position is included in the sine wave information is decoded as needed.
[00135] In a step S58, the sine wave information decoding unit 105 performs the sine wave signal generation processing to generate the sine wave signal for each band on the high frequency side, and supplies it to the filter of bandpass combination 106. In addition, the details of sine wave signal generation processing will be described later.
[00136] In a step S59, the bandpass combining filter 106 combines the bands of the low-frequency signal from the low-frequency decoding unit 102, the high-frequency pseudo signal from the envelope information decoding unit 103, the noise signal from the noise envelope information decoding unit 104, and the sine wave signal from the sine wave information decoding unit 105.
[00137] That is, the audio signal is generated by performing the band combination adding at each time the low frequency signal, the high frequency pseudo signal for each band, the noise signal for each band, and the sine wave signal for each band input from the low frequency decoding unit 102 through the sine wave information decoding unit 105. Here, the signal composed of the high frequency pseudo signal, the noise signal, and the sine wave signal is the high frequency component obtained through prognosis.
[00138] When the audio signal has been obtained by band combining, the bandpass combining filter 106 outputs this audio signal to a down stream execution unit or the like, and the decoding processing ends. This decoding processing is performed per frame, and as the next frame of the encoding data stream is input, the decoding device 91 performs decoding processing on this frame of the encoding data stream.
[00139] In this way, the decoding device 91 predicts the high frequency components based on the low frequency signal, the envelope information, the noise envelope information, and the sine wave information, and generates the audio signal. expanding the bands from the high-frequency signal obtained through prediction and the decoded low-frequency signal. At this time, by using the sine wave information representing a more accurate starting position of sine wave signal matching, a more accurate sine wave signal matching can be effected, and thus higher audio quality audio can be obtained. [Description of Sine Wave Signal Generation Processing]
[00140] Next, the sine wave signal generation processing corresponding to the processing step S58 in Fig. 6 will be described with reference to the flowchart in Fig. 7.
[00141] In a step S81, the generation unit 141 in the sine wave information decoding unit 105 determines whether the start time for sine wave signal combination processing has elapsed or not based on the combination start position and in the information included in the sine wave information representing whether or not the sine wave signal was detected.
[00142] For example, the generation unit 141 generates the sine wave signal as the sine wave component by setting the high frequency component by designating the beginning of the frame as the initial position of emergence and the end of the frame with the ending position of emergence.
[00143] Here, the frequency of the sine wave signal designated as the sine wave component setting the high frequency component is identified by the information included in the sine wave information representing whether or not the sine wave signal was detected. Furthermore, the amplitude of the sine wave signal frequency identified by the sine wave information is identified from the envelope information provided from the envelope information decoding unit 103 through the sine wave information decoding unit 105. For example, the generation unit 141 converts the envelope information into frequencies, and obtains the amplitude of the sine wave signal based on the power of the frequency of the sine wave signal among the power of all the frequencies obtained, as a result.
[00144] Next, the generating unit 141 selects the sample at a start position of the time interval for a frame of the sine wave signal as the sample (time interval) to be processed so from the beginning of the frame. Then, the generation unit 141 determines whether or not the selected sample position is the sample position represented by the combination start position, that is to say the time at which the combination of the sine wave signal is to be started. For example, when information included in the sine wave information indicates that the sine wave signal has not been detected, it will continue to be determined that the start time of the sine wave combination has not elapsed.
[00145] When it has been determined that the start time has not passed in step S81, in a step S82, the generating unit 141 shifts the generated sine wave signal backward or one timeline by one time interval. As a result, the sine wave signal's starting position is shifted backward in a timeline. When shifting the sine wave signal is performed, the sine wave has not yet emerged in the time slot to be processed, and thus the sine wave signal is not output from the sine wave information decoding unit 105 to the bandpass combination filter 106.
[00146] In a step S83, the generation unit 141 determines whether the end of a frame has been reached or not. For example, when the zone for the final timeslot setting the frame is being processed, that is, when all timeslots in the frame have been processed, it is determined that the end of the frame has been reached.
[00147] When it has been determined that the end of the frame has not been reached in step S83, the next time interval is selected as the one to be processed, processing returns to step S81, and the processing described above is repeated. In this case, offset processing, etc., is performed on the already generated sine wave signal.
[00148] Conversely, when it has been determined that the end of the frame has been reached in step S83, the sine wave signal generation processing ends, and after that, processing proceeds to step S59 in Fig. 6. In this case, the result is that sine wave signal combination is not performed.
[00149] In addition, when it has been determined that the start position of the sine wave combination processing has passed in step S81, in a step S84, the generating unit 141 performs the sine wave combination processing. That is, the generation unit 141 outputs to the bandpass combination filter 106 the sample value setting the time interval being processed of the sine wave signal which has been arbitrarily processed in displacement. As a result, the sample value of the emitted sine wave signal sample is combined with the low frequency signal as the sine wave component by setting the high frequency component.
[00150] In a step S85, the generation unit 141 determines whether the end of a frame has been reached or not. For example, when the zone for the final timeslot setting the frame is being processed, that is, when all the timeslots in the frame have been processed, it is determined that the end of the frame has been reached.
[00151] When it has been determined that the end of frame has not been reached in step S85, the next time interval is selected as the one to be processed, processing returns to step S84, and the processing described above is repeated. Conversely, when it has been determined that the end of frame has been reached in step S85, the sine wave signal generation processing ends, and after that, processing proceeds to step S59 in Fig. 6.
[00152] In this way, the sine wave information decoding unit 105 shifts the sine wave signal emerging home position to the combination home position based on the sine wave information, and outputs the shifted sine wave signal. As a result, the sine wave combination is initiated at a more precise position in a frame, and thus audio at a higher audio quality can be obtained.<Second Modality>[Example Encoding Device Configuration]
[00153] Although it has been described above that the combination start position representing the time (number of samples) from the frame start position to the position at which the sine wave signal combination should start is included in the wave information sinusoidal, information of the difference between the initial combination position and the noise boundary position can be included.
[00154] In this case, the encoding device is configured as illustrated in Fig. 8. Furthermore, the components in Fig. 8 that correspond to those in Fig. 1 have the same reference numerals, and thus their descriptions will be omitted as appropriate . An encoding device 171 in Fig. 8 and encoding device 11 are different in that difference calculating unit 181 is newly provisioned to sine wave information generating unit 26 of encoding device 171, and thus being, they are the same considering other components.
[00155] The difference calculating unit 181 in the sine wave information generating unit 26 calculates the difference between the starting position of combining the sine wave signal detected by the position detection unit 62 and the noise boundary position. The sine wave information generating unit 26 supplies information made from the difference information representing the difference with the noise boundary position calculated by the difference calculating unit 181 and the information representing whether the sine wave signal was or was not detected for the encoding data stream generating unit 27 as the sine wave information.[Description of Encoding Processing]
[00156] In the following, the encoding processing performed by the encoding device 171 will be described with reference to the flowchart in Fig. 9. In addition, the processing from step S111 to step S118 is the same as step S11 to step S18 in Fig. 2., and so its description is omitted.
[00157] In a step S119, the boundary calculation unit 52 in the noise envelope information generation unit 25 detects the noise boundary position for each band on the high frequency side. Then, in a step S20, the noise envelope information generation unit 25 generates the noise envelope information for each band on the high frequency side, and supplies it to the encoding data stream generation unit 27. Furthermore, in step S119 and step S120, the same processing as in step S20 and step S21 in Fig. 2 is performed.
[00158] In a step S121, the difference calculating unit 181 in the sine wave information generating unit 26 calculates the difference between the noise boundary position and the sine wave signal combination start position detected by the sine wave unit. position detection 62.
[00159] For example, as illustrated in Fig. 10, the time (number of samples) from the initial position of the sine wave combination to the noise boundary position is calculated as the difference. Also, the horizontal axis in the figure represents the timeline. Furthermore, an arrow FS11 and an arrow FE11 in Fig. 10 represent the starting position and the ending position of the frame, respectively.
[00160] According to the example in Fig. 10, the position represented by an arrow N11 in the frame represents the noise boundary position. In addition, the combination start position of the sine wave signal is the position represented by a G11 arrow, and the combination start position is positioned before the noise boundary position. Therefore, the sine wave signal is combined in the zone from the initial combination position represented by the arrow G11 to the frame position.
[00161] According to this example, the length of time (temporal distance) from the combination initial position represented by arrow G11 to the noise boundary position represented by arrow N11 is designated as the difference information with the position of noise boundary. Here, the time from the initial combination position to the noise boundary position is an integral multiple of the length of the time interval.
[00162] Using the difference information representing the time from the combination start position to the noise boundary position obtained in this way, a more accurate combination start position can also be identified on the decoding side of the audio signal, and thus audio at a higher audio quality can be obtained.
[00163] Returning to the description of the flowchart in Fig. 9, after the difference information with the noise boundary position is obtained in step S121, processing proceeds to step S122.
[00164] In a step S122, the sine wave information generation unit 26 generates the sine wave information for each band on the high frequency side, and supplies it to the encoding data stream generation unit 27.
[00165] For example, the sine wave information generating unit 26 designates the information made from the information representing whether or not the sine wave was detected from the high frequency band and the difference information between the initial position of combination and the noise boundary position as the sine wave information. At this time, the coding unit 63 in the sine wave information generating unit 26 performs variable length coding of the difference information with the noise boundary position. The sine wave information generating unit 26 supplies the sine wave information made from the difference information processed by the variable length encoding and the information representing whether or not the sine wave signal has been detected to the flow generating unit of encoding data 27.
[00166] After the sine wave information is generated, the processing in a step S123 is performed and the encoding processing ends, and as the processing in step S123 is the same as the processing in step S22 in Fig. 2, so this description is omitted.
[00167] As previously described, the encoding device 171 generates and outputs the encoding data stream made from the low frequency signal, the envelope information, the noise envelope information, and the sine wave information. At this time, by detecting a more accurate combination start position of the sine wave signal and generating sine wave information including the difference information used to identify this combination start position, a more accurate combination of the sine wave signal can be performed during the decoding, and thus audio at a higher audio quality can be obtained as a result.[Decoding Device Configuration Example]
[00168] Furthermore, a decoding device that receives the encoding data stream transmitted from the encoding device 171, and obtains the audio signal from the encoding data stream is configured as illustrated in Fig. 11. Furthermore, the components in Fig. 11 that correspond to those in Fig. 5 have the same reference numerals, and thus their descriptions will be omitted as appropriate. A decoding device 211 in Fig. 11 and the decoding device 91 are different in that the position calculating unit 221 is newly provisioned to the sine wave information decoding unit 105 of the decoding device 211, and thus are the same considering other components.
[00169] The position calculation unit 221 in the decoding device 211 calculates the combination start position of the sine wave signal from the difference information obtained from the sine wave information and the noise boundary position provided from of the noise envelope information decoding unit 104.[Decoding Processing Description]
[00170] Next, the decoding processing performed by the decoding device 211 will be described with reference to the flowchart in Fig. 12. Note that, processing from step S151 to step S157 is the same as processing from step S157 S51 to step S57 in Fig. 6, and thus their descriptions will be omitted. However, in step S155, the noise envelope information decoding unit 104 supplies the information representing the noise boundary position included in the noise envelope information obtained from the decoding to the sine wave information decoding unit 105 .
[00171] In a step S158, the sine wave information decoding unit 105 performs the sine wave signal generation processing, generates the sine wave signal for each band on the high frequency side, and supplies it to the filter of bandpass combination 106. In addition, details of sine wave signal generation processing will be described later.
[00172] After the sine wave signal generation processing has been performed, the processing in a step S159 is performed, and the decoding processing ends, and as the processing in the step S159 is the same as in the step S59 in Fig. 6, its description will be omitted.[Description of Sine Wave Signal Generation Processing]
[00173] Further, in step S158 in Fig. 12, the sine wave information decoding unit 105 performs the sine wave signal generation processing illustrated in Fig. 13. Hereinafter, the signal generation processing of sine wave corresponding to the processing in step S158 will be described with reference to the flowchart in Fig. 13.
[00174] In a step S181, the position calculating unit 221 in the sine wave information decoding unit 105 calculates the combination start position of the sine wave signal from the noise boundary position provided from the unit. decoding noise envelope information 104 and the difference information obtained from the sine wave information. That is, the difference in time between the combination start position and the noise boundary position is subtracted from the time from the start position of the frame being processed to the noise boundary position, the time from the start position of the frame until the combination start position of the sine wave signal is obtained, and the time (sample) of the combination start position is identified.
[00175] After the combination start position is calculated, processing from step S182 to step S186 is performed, and sine wave signal generation processing ends, and as this processing is the same as processing from step S81 to step S85 in Fig. 7, its description will be omitted. After the sine wave signal generation processing is finished in this way, processing proceeds to step S159 in Fig. 12.
[00176] In this way, the sine wave information decoding unit 105 calculates a more accurate combination initial position of the sine wave signal from the difference information included in the signal sine wave information and the noise boundary position. As a result, the sine wave signal combination is initiated at a more precise position in a frame, and thus audio at a higher audio quality can be obtained.<Third mode>[Example Encoding Device Configuration]
[00177] Although the second modality has been described above with an example in which the difference information between the combination start position and the noise boundary position is included in the sine wave information, the difference information between the peak position of the Combination start position and the envelope of the high frequency signal can be included.
[00178] In this case, the encoding device is configured as illustrated in Fig. 14. Furthermore, the components in Fig. 14 that correspond to those in Fig. 1 have the same reference numerals, and thus their descriptions will be omitted as appropriate . An encoding device 251 in Fig. 14 and encoding device 11 are different in that the peak detection unit 261 and the difference calculating unit 262 are newly provisioned to the sine wave information generating unit 26 of the coding device 251, and thus are the same considering other components.
[00179] According to the encoding device 251, the envelope information provided from the envelope information generating unit 24 to the noise envelope information generating unit 25 is also provided from the noise generating unit. noise envelope information 25 to the sine wave information generating unit 26. The peak detection unit 261 detects the peak position of the envelope of the high frequency signal based on the envelope information provided from the generating unit of noise envelope information 25.
[00180] The difference calculating unit 262 calculates the difference between the initial position of the sine wave signal combination detected by the position detection unit 62 and the peak position of the high frequency signal envelope. The sine wave information generating unit 26 supplies the information made from the difference information representing the difference with the peak position calculated by the difference calculating unit 262 and the information representing whether or not the sine wave signal was detected to the encoding data stream generating unit 27 as the sine wave information. [Encoding Processing Description]
[00181] In the following, the encoding processing performed by the encoding device 251 will be described with reference to the flowchart in Fig. 15. Furthermore, the processing from step S211 to step S218 is same as from step S11 to step S18 in Fig. 2, and so its description will be omitted. However, in step S214, the generated envelope information is also provided to the sine wave information generating unit 26 from the envelope information generating unit 24 via the noise envelope information generating unit 25.
[00182] In a step S219, the peak detection unit 261 in the sine wave information generating unit 26 detects the peak position of the envelope of the high frequency signal based on the envelope information provided from the generating unit of noise envelope information 25. For example, the position where the gain of the envelope of the high frequency signal represented by the envelope information is at a maximum is detected as the peak position of the envelope of the high frequency signal.
[00183] In a step S220, the difference calculating unit 262 calculates, for each band on the high frequency side, the difference between the initial position of combination of the sine wave signal detected by the position detection unit 62 and the position envelope peak detected by peak detection unit 261.
[00184] For example, as illustrated in Fig. 16, the time (number of samples) from the initial position of the sine wave combination to the peak position is calculated as the difference. Also, the horizontal axis in the figure represents the timeline. Furthermore, an arrow FS21 and an arrow FE21 in Fig. 16 represent the starting position and the ending position of the frame, respectively.
[00185] According to the example in Fig. 16, the envelope of the high frequency signal is represented by a dotted line, and the position represented by an arrow P1 in the frame represents the peak position of this envelope. In addition, the combination start position of the sine wave signal is the position represented by an arrow G21, and the combination start position is positioned before the peak position of the envelope. During decoding, the sine wave signal is combined in the zone from the combination start position represented by arrow G21 to the frame end position.
[00186] According to this example, the length of time (temporal distance) from the initial position of combination represented by arrow G21 to the peak position of the envelope of the high frequency signal represented by arrow P1 is designated as the difference with the peak position. Here, the time from the initial blend position to the peak position is an integral multiple of the time interval length.
[00187] Using the difference information representing the time from the combination start position to the peak position obtained in this way, a more accurate combination start position can be identified during audio signal decoding, and thus audio in a higher audio quality can be obtained.
[00188] Returning to the description of the flowchart in Fig. 15, after the difference information with the peak position is obtained in step S220, processing proceeds to step S221.
[00189] In step S221, the sine wave information generation unit 26 generates the sine wave information for each band on the high frequency side, and supplies it to the encoding data stream generation unit 27.
[00190] For example, the sine wave information generation unit 26 designates the information made from the information representing whether or not the sine wave was detected from the high frequency band and the difference information between the initial position of combination and the peak position as the sine wave information. At this time, the coding unit 63 in the sine wave information generating unit 26 performs variable length coding of the difference information with the peak position. The sine wave information generating unit 26 supplies the sine wave information made from the difference information processed by the variable length encoding and the information representing whether or not the sine wave signal has been detected to the flow generating unit of encoding data 27.
[00191] After the sine wave information is generated, the processing in a step S222 to step S224 is performed and the encoding processing ends, and as this processing is the same as the processing in step S20 to step S22 in Fig. 2 , then this description is omitted.
[00192] As previously described, the encoding device 251 generates and outputs the encoding data stream made from the low frequency signal, the envelope information, the noise envelope information, and the sine wave information. At this time, by detecting a more accurate combination start position of the sine wave signal and generating sine wave information including the difference information used to identify this combination start position, a more accurate combination of the sine wave signal can be performed during decoding , and thus audio at a higher audio quality can be obtained as a result.[Decoding Device Configuration Example]
[00193] Furthermore, a decoding device that receives the encoding data stream transmitted from the encoding device 251 and obtains the audio signal from the encoding data stream is configured as illustrated in Fig. 17. Furthermore, the components in Fig. 17 that correspond to those in Fig. 5 have the same reference numerals, and thus their descriptions will be omitted as appropriate. A decoding device 301 in Fig. 17 and the decoding device 91 are different in that the position calculating unit 311 is newly provisioned to the sine wave information decoding unit 105 of the decoding device 301, and thus are the same considering other components.
[00194] The position calculation unit 311 in the decoding device 301 calculates the combination start position of the sine wave signal from the difference information obtained from the sine wave information and the envelope information provided from the unit envelope information decoding 103.[Decoding Processing Description]
[00195] In the following, the decoding processing performed by the decoding device 301 will be described with reference to the flowchart in Fig. 18. In addition, the processing from step S251 to step S257 is the same as from step S51 to step S57 in Fig. 6, and so its description will be omitted.
[00196] In a step S258, the sine wave information decoding unit 105 performs the sine wave signal generation processing, generates the sine wave signal for each band on the high frequency side, and supplies it to the filter of bandpass combination 106. In addition, details of sine wave signal generation processing will be described later.
[00197] After the sine wave signal generation processing has been performed, the processing in a step S259 is performed, and the decoding processing ends, and as the processing in the step S259 is the same as in the step S59 in Fig. 6, its description is omitted.[Description of Sine Wave Signal Generation Processing]
[00198] In addition, in step S258 in Fig. 18, the sine wave information decoding unit 105 performs the sine wave signal generation processing illustrated in Fig. 19. Hereinafter, the signal generation processing of sine wave corresponding to the processing in step S258 will be described with reference to the flowchart in Fig. 19.
[00199] In a step S281, the position calculating unit 311 in the sine wave information decoding unit 105 calculates the combination start position of the sine wave signal from the envelope information provided from the sine wave decoding unit. envelope information 103 and the difference information obtained from the sine wave information.
[00200] That is, the position where the gain of the envelope of the high frequency signal represented in the envelope information is at a maximum is calculated by the position calculation unit 311 as the peak position of the envelope of the high frequency signal. Then, the position calculation unit 311 subtracts the difference in time between the combination start position and the peak position which is subtracted from the time from the start position of the frame being processed to the peak position, the time from the frame start position to the sine wave signal combination start position, and the time (sample) of the combination start position is identified.
[00201] After the combination start position is calculated, processing from step S282 to step S286 is performed, and sine wave signal generation processing ends, and as this processing is the same as processing from step S81 to step S85 in Fig. 7, its description is issued. After the sine wave signal generation processing ends in this manner, processing proceeds to step S259 in Fig. 18.
[00202] In this way, the sine wave information decoding unit 105 calculates a more accurate combination initial position of the sine wave signal from the difference information included in the sine wave information and the peak position of the signal envelope. high frequency. As a result, the combination of the sine wave signal is initiated at a more precise position within a frame, and thus higher quality audio can be obtained.
[00203] Furthermore, although an example has been described above in which the detection of the peak position of the envelope is performed on the side of the decoding device 301, information representing the peak position can be included in the sine wave information. In this case, the sine wave information generating unit 26 in the encoding device 251 generates the sine wave information including the information representing the peak position, and the position calculating unit 311 in the decoding device 301 calculates the start position. of combination from the difference information and the information representing the peak position included in the sine wave information.<Fourth Mode>[Example Encoding Device Configuration]
[00204] Although an example has been described above that the sine wave information included in a previously determined type of information among, the combination start position, the difference information with the noise boundary position, or the difference information with the peak position, the information among those with the least amount of encoding can be selected to be included in the sine wave information.
[00205] In this case, the encoding device is configured as illustrated in Fig. 20, for example. In addition, components in Fig. 20 that correspond to those in Fig. 1 or Fig. 14 have the same reference numerals, and thus their descriptions will be omitted as appropriate. An encoding device 341 in Fig. 20 and an encoding device 11 in Fig. 1 are different in that the peak detection unit 261, the difference calculation unit 351 and the selection unit 352 are newly provisioned in the sine wave information generating unit 26 of the encoding device 341, and thus are the same considering other components.
[00206] According to the encoding device 341, the envelope information provided from the envelope information generating unit 24 to the noise envelope information generating unit 25 is also provided from the noise generating unit. noise envelope information 25 to the sine wave information generating unit 26, and the peak detection unit 261 detects the peak position of the envelope of the high frequency signal based on the envelope information.
[00207] The difference calculating unit 351 calculates the difference between the initial position of the sine wave signal combination detected by the position detection unit 62 and the peak position of the high frequency signal envelope. The difference calculation unit 351 also calculates the difference between the combination start position and the noise boundary position.
[00208] The selection unit 352 selects the information that will result in the least amount of encoding after variable length encoding among the combination start position, the peak position difference information, or the position difference information of noise border. The sine wave information generating unit 26 supplies the information made from the information representing the result of the selection by the selection unit 352, the information selected by the selection unit 352, and the information representing whether the sine wave signal was or not detected, to the encoding data stream generating unit 27 as sine wave information.[Encoding Processing Description]
[00209] In the following, the encoding processing performed by the encoding device 341 will be described with reference to the flowchart in Fig. 21. Furthermore, the processing from step S311 to step S321 is the same as from step S111 to step S121 in Fig. 9, and so its description will be omitted.
[00210] However, in step S321, the difference calculating unit 351 in the sine wave information generating unit 26 calculates the difference between the initial position of combination sine wave signal detected by the position detection unit 62 and the noise boundary position for each band on the high frequency side. Furthermore, in step S314, the generated envelope information is also provided to the sine wave information generating unit 26 from the envelope information generating unit 24 through the noise envelope information generating unit 25.
[00211] In a step S322, the peak detection unit 261 in the sine wave information generating unit 26 detects, for each band on the high frequency side, the peak position of the envelope of the high frequency signal based on the envelope information provided from the noise envelope information generation unit 25.
[00212] In a step S323, a difference calculating unit 351 calculates, for each band on the high frequency side, the difference between the sine wave signal combination start position detected by the position detection unit 62 and the position envelope peak detected by peak detection unit 261.
[00213] Furthermore, the same processing in step S219 and in step S220 in Fig. 15 is performed in step S322 and in step S323.
[00214] In a step S324, the selection unit 352 selects, for each band on the high-frequency side, the information that will result in the least amount of encoding after variable-length encoding among the initial combination position, the information of difference between the combination start position and the peak position, or the difference information between the combination start position and the noise boundary position. Then the selection unit 352 generates the selection information representing the result of this selection. At this time, only the encoding amount of the combination start position or similar can be calculated and compared, or the effective combination start position or similar information can be processed by variable length encoding, and this encoding amount can be compared.
[00215] In step S325, the sine wave information generation unit 26 generates the sine wave information for each band on the high frequency side, and supplies it to the encoding data stream generation unit 27.
[00216] Specifically, the sine wave information generating unit 26 designates the information made from the information representing whether or not the sine wave signal was detected from the high frequency band, the selection information, and the information representing the selection information as the sine wave information. At this time, the encoding unit 63 in the sine wave information generating unit 26 performs variable length encoding of the selection information and the information representing the selection information. The sine wave information generating unit 26 supplies the sine wave information made from the selection information and the information representing the selection information processed by the variable length coding and the information representing whether the sine wave signal was or was not detected for the encoding data stream generating unit 27.
[00217] For example, when the information representing the selection information is the difference information between the combination start position and the peak position, the information made from the selection information, the difference information with the peak position , and the information representing whether or not the sine wave signal was detected is designated as the sine wave information. In this way, by generating the sine wave information including the information with the smallest amount of encoding that identifies the starting position of combining the sine wave signal, the encoding amount of the encoding data stream can be further reduced.
[00218] After the sine wave information is generated, processing in a step S326 is performed and encoding processing ends, and as this processing is the same as processing in step S224 in Fig. 15, its description is omitted.
[00219] As previously described, the encoding device 341 generates and outputs the encoding data stream made from the low frequency signal, the envelope information, the noise envelope information, and the sine wave information. At this time, by generating the sine wave information including the information with the least amount of encoding among the information identifying the starting position of the combination sine wave signal, the amount of data of the encoding data stream to be transferred can be reduced , and at the same time, more accurate sine wave signal matching can be performed during decoding on the decoding side of the audio signal. As a result, audio in a higher audio quality can be obtained.[Decoding Device Configuration Example]
[00220] Furthermore, a decoding device that receives the encoding data stream transmitted from the encoding device 341, and obtains the audio signal from the encoding data stream is configured as illustrated in Fig. 22, for example. Furthermore, the components in Fig. 22 that correspond to those in Fig. 5 have the same reference numerals, and thus their descriptions will be omitted as appropriate. A decoding device 381 in Fig. 22 and the decoding device 91 are different in that the position calculating unit 391 is newly provisioned to the sine wave information decoding unit 105 of the decoding device 381, and so are the same considering other components.
[00221] The position calculation unit 391 in the decoding device 381 calculates the initial position of combining the sine wave signal or the difference information with the peak position or the difference information with the noise boundary position obtained at from the sine wave information, depending on the selection information included in the sine wave information.[Decoding Processing Description]
[00222] In the following, the decoding processing performed by the decoding device 381 will be described with reference to the flowchart in Fig. 23. In addition, the processing from step S351 to step S356 is the same as step S51 to step S56 in Fig. 6, and so its description will be omitted.
[00223] However, in step 355, the noise envelope information decoding unit 104 supplies the information representing the noise boundary position included in the noise envelope information obtained by decoding to the sine wave information decoding unit 105.
[00224] In a step S357, the sine wave information decoding unit 105 decodes the sine wave information from the encoding data stream decoding unit 101. For example, the selection information included in the wave information sinusoidal, and the information used to obtain the initial position of the combination identified by the selection information, are decoded.
[00225] In a step S358, the sine wave information decoding unit 105 performs the sine wave signal generation processing, generates the sine wave signal for each band on the high frequency side, and supplies it to the filter of bandpass combination 106. In addition, details of sine wave signal generation processing will be described later.
[00226] After the sine wave signal generation processing has been performed, the processing in a step S359 is performed, and the decoding processing ends, and as the processing in the step S359 is the same as in the step S59 in Fig. 6, its description is omitted.[Description of Sine Wave Signal Generation Processing]
[00227] Further, in step S358 in Fig. 23, the sine wave information decoding unit 105 performs the sine wave signal generation processing illustrated in Fig. 24. Hereinafter, the signal generation processing of sine wave corresponding to the processing in step S358 will be described with reference to the flowchart in Fig. 24.
[00228] In a step S381, the position calculation unit 391 determines whether or not the information used to obtain the combination start position of the sine wave signal represented by the selection information is the information actually representing the combination start position. That is, it is determined whether or not the combination start position is included in the sine wave information.
[00229] In the event that determination is made in step S381 that the information represented by the selection information is the information representing the combination start position of the sine wave signal, processing proceeds to step S385.
[00230] Conversely, in the event that determination is made in step S381 that the information represented by the selection information is not to be the information representing the combination start position of the sine wave signal, processing proceeds to step S382.
[00231] In step S382, the position calculation unit 391 determines whether or not the information used to obtain the combination start position of the sine wave signal represented by the selection information is the difference information between the combination start position and the noise boundary position. That is, it is determined whether or not the difference information with the noise boundary position is included in the sine wave information.
[00232] When the information represented by the selection information is determined to be the difference information with the noise boundary position, processing proceeds to step S383.
[00233] In step S383, the position calculating unit 391 in the sine wave information decoding unit 105 calculates the combination start position of the sine wave signal from the noise boundary position provided from the decoding unit of noise envelope information 104 and the difference information with the noise boundary position obtained from the sine wave information. After the combination start position is calculated, processing proceeds to step S385.
[00234] Furthermore, when the information represented by the selection information is determined not to be the difference information with the noise boundary position in step S382, that is, when the information represented by the selection information is the difference information between the combination start position and the peak position, processing proceeds to step S384.
[00235] In step S384, the position calculating unit 391 in the sine wave information decoding unit 105 calculates the sine wave signal combination start position from the envelope information provided from the information decoding unit of envelope 103 and the difference information with the peak position of the envelope of the high frequency signal obtained from the sine wave information.
[00236] That is, the position calculating unit 391 detects the position where the gain in the envelope of the high frequency signal represented by the envelope information is at a maximum as per the peak position of the envelope of the high frequency signal. Then the position calculation unit 391 subtracts the difference in time between the combination start position and the peak position from the time from the start position of the frame to be processed to the peak position, obtains the time from from the frame start position to the sine wave signal combination start position, and identifies the time (sample) of the combination start position. After the combination start position is calculated, processing proceeds to step S385.
[00237] After the information represented by the selection information is determined to be the information representing the combination start position in step S381, or the combination start position is calculated in step S383, or the combination start position is calculated in step S384 , processing proceeds to step S385. Then, processing from step S382 to step S389 is performed, and sine wave signal generation processing ends, and as this processing is the same as processing from step S81 to step S85 in Fig. 7, its description is omitted . After the sine wave signal generation processing ends in this manner, processing proceeds to step S359 in Fig. 23.
[00238] In this way, the sine wave information decoding unit 105 identifies the information included in the sine wave information from the selection information, and arbitrarily calculates a more accurate combination initial position of the sine wave signal. according to the result of this specification. As a result, the sine wave signal combination is initiated at a more precise position within a frame, and thus audio at a higher audio quality can be obtained.
[00239] The series of processing described above can be performed by hardware, or can be performed by software. When the series of processing is performed by software, a program configuring this software can be installed on a computer built with specialized hardware, or by installing various programs from a program recording medium on a general purpose personal computer, for example, which can perform various functions.
[00240] Fig. 25 is a block diagram illustrating an example of computer hardware configuration to perform the series of processing described above as a program.
[00241] A CPU 501, ROM (Read Only Memory) 502, and RAM (Random Access Memory) 503, are connected together in the computer via a 504 bus.
[00242] In addition, a 505 input/output interface is connected to co 504. Devices connected to the 505 input/output interface include an input unit 506 consisting of a keyboard, a mouse, a microphone, etc., a unit output unit 507 consisting of a monitor, speaker, etc., a recording unit 508 consisting of a hard disk, non-volatile memory, etc., a communication unit 509 consisting of a network interface, etc., and a media controller 510 for operating a magnetic disk, an optical disk, an optical magnetic disk, or a removable media 511 such as semiconductor memory.
[00243] According to the computer configured in this way, the CPU 501 loads and executes the program installed in the recording unit 508 in RAM 503 through the input/output interface 505 and bus 504, for example, to carry out the series of processing previously described.
[00244] The program executed by the processor (CPU 501) can be recorded on removable media 511, which is a form of packaged media configured from, for example, a magnetic disk (including a floppy disk), an optical disk (such as CD -ROM (Compact Disc - Read Only Memory) or DVD (Digital Versatile Disc)), an optical magnetic disc, or semiconductor memory, etc., or can be provided via a wired or wireless transmission medium such as the local area network, the Internet, or a digital satellite broadcast.
[00245] In addition, the program can be installed on the recording unit 508 via the 505 input/output interface by installing the removable media 511 on the media controller 510. In addition, the program can be installed on the recording unit 508 after being received by the communication unit 509 via a wired or wireless transfer medium. In addition, the program can be preinstalled on ROM 502 or recording drive 508.
[00246] In addition, the program executed by the processor may perform in-order processing of data streams in time as described in the present specification, may perform processing in parallel, or at a necessary time such as when a call is made.
[00247] In addition, the pre-established technology modalities are not limited to the previously described modalities, and various modifications may occur as they are within the scope of the present technology. Reference Signal List11 - encoding device22 - unit frequency coding unit24 - envelope information generating unit25 - noise envelope information generating unit26 - sine wave information generating unit 52 - boundary calculation unit61 - sine wave detection unit62 - sine wave information unit position detection91 - decoding device102 - low frequency decoding unit103 - envelope information decoding unit104 - noise envelope information decoding unit105 - sine wave information decoding unit141 - generation unit181 - calculation unit difference221 - position calculation unit261 - d detection unit and pico262 - difference calculation unit 311 - position detection unit351 - difference calculation unit352 - selection unit391 - position calculation unit

权利要求:
Claims (16)
[0001]
1. Signal processing device characterized in that it comprises: an extraction unit configured to extract a low-frequency component of an audio signal, envelope information representing an envelope of a high-frequency component of the audio signal, and a sine wave information that includes information representing a distance from a start position of a frame of the high frequency component to an emerging start position of a sine wave component included in the high frequency component, and is used to specify a frequency and a emersion position of sine wave components; a high-frequency pseudo-generating unit for generating a high-frequency pseudo signal by configuring the high-frequency component based on the low-frequency signal component as the low-frequency component and the envelope information; a sine wave generating unit configured to generate a sine wave signal in a frequency represented by the sine wave information and designating the emerging initial position identified from the sine wave information is set as the initial position within a frame; and a combining unit configured to combine the low frequency signal, the high frequency pseudo signal, and the sine wave signal to generate the audio signal.
[0002]
2. Signal processing device according to claim 1, further characterized in that it comprises: a noise generation unit that generates a noise signal configuring the high frequency components by adjusting a gain of zones of a pre- determined on the basis of information representing a gain of the zones represented by the noise envelope information, in which the zones are divided by a noise boundary position represented by a noise envelope information; wherein the extraction unit still extracts the information of noise envelope; and wherein the combining unit combines the low frequency signal, the high frequency pseudo signal, the sine wave signal, and the noise signal to generate the audio signal.
[0003]
3. Signal processing device according to claim 1, characterized in that the sine wave information is extracted for each frame, and the sine wave generator unit generates the sine wave signal for each frame of the component. high frequency.
[0004]
4. Signal processing device according to claim 1, characterized in that the sine wave information is extracted for each band configuring the high frequency components, and the sine wave generating unit generates the wave signal sinusoidal for each band.
[0005]
5. Signal processing method for controlling a signal processing device, the signal processing device wherein an extraction unit configured to extract a low frequency component of an audio signal, envelope information representing an envelope of a component frequency of the audio signal and a used sine wave information that includes information representing a distance from a start position of a frame of the high frequency component to an emersion start position of a sine wave component included in the high frequency component , and to specify a frequency and an emersion position of the high-frequency components; a high-frequency pseudo-generating unit for generating a high-frequency pseudo-signal by configuring the high-frequency components based on a low-frequency signal as the low-frequency component and the envelope information; a sine wave generating unit configured to generate a sine wave signal at a frequency represented by the sine wave information and at which the emerging position identified from the sine wave information is set as the start position within a frame; and a combination unit configured to combine the low frequency signal, the high frequency pseudo signal, and the sine wave signal to generate the audio signal, the method characterized by understanding the steps of: extracting using, the extraction unit , the low-frequency components, the envelope information, and the sine wave information; generate, using the high-frequency pseudo-generating unit, the high-frequency pseudo-signal; sine wave; and combine, using the combine unit, the low frequency signal, the high frequency pseudo signal, and the sine wave signal to generate the audio signal.
[0006]
6. A computer-readable storage medium, characterized in that it comprises instructions that, when executed by a processor, perform the steps of extracting a low-frequency component from an audio signal, envelope information representing an envelope of high-frequency components of the audio signal, and a sine wave information which includes information representing a distance from an initial position of a frame of the high frequency component to an emerging initial position of a sine wave component included in the high frequency component, and is used to specify a frequency and an emersion position of the sine wave components; generate a high-frequency pseudo signal by setting the high-frequency component based on the low-frequency signal component as the low-frequency component and the envelope information; a sine wave signal at a frequency represented by the sine wave information and the which emerging home position identified from the sine wave information is set as the home position within a frame; and combine the low frequency signal, the high frequency pseudo signal, and the sine wave signal to generate the audio signal.
[0007]
7. Signal processing device, characterized in that it comprises: an envelope information generating unit configured to generate envelope information representing an envelope of a high frequency signal signal as a high frequency component of an audio signal a sine wave information generating unit configured to detect a sine wave signal included in the high frequency signal, and generate a sine wave information which includes information representing a distance from a start position of a frame of the component. high frequency to a sine wave signal emerging home position, and is to specify a frequency and a sine wave signal emerging home position set as a home position within a frame; and an output unit configured to generate and output configured data from a low frequency signal such as a low frequency component of the audio signal, the envelope information, and the sine wave information.
[0008]
8. Signal processing device according to claim 7, further characterized in that it comprises: a noise envelope information generation unit configured to detect a noise signal included in the high frequency signal, and generate a noise envelope information configured from information representing the noise boundary position which divides the noise signal into several zones and from information representing a gain of the noise signal in the section; and in which the output unit generates and outputs data created from low frequency signal, envelope information, sine wave information, and noise envelope information.
[0009]
9. Signal processing device according to claim 7, characterized in that the sine wave information is generated for each frame.
[0010]
10. Signal processing device according to claim 7, characterized in that the sine wave information is generated for each band configuring the high frequency components.
[0011]
11. Signal processing method for controlling a signal processing device, the signal processing device including an envelope information generating unit configured to generate envelope information representing an envelope of a high frequency signal as a high frequency component. frequency of an audio signal; a sine wave information generating unit configured to detect sine wave information included in the high frequency signal, and generate a sine wave information that includes information representing a distance from a starting position of a frame. from the high frequency component to a sine wave signal emersion start position, and is to specify a sine wave signal emersion frequency and position set as a start position within a frame; and an output unit configured to generate and output data configured from the low frequency signal as a low frequency component of the audio signal, the envelope information, and the sine wave information, the method characterized in that it comprises the steps of: generating, using the envelope information generating unit, the envelope information; generating, using the sine wave information generating unit, the sine wave information; and output, using the output unit, configured data from the low frequency signal, the envelope information, and the sine wave information.
[0012]
12. A computer readable storage medium, characterized in that it comprises instructions which, when executed by a processor, perform the steps of generating envelope information representing an envelope of a high frequency signal as a high frequency component of a signal. audio, detecting a sine wave signal included in the high frequency signal, and generating a sine wave information that includes information representing a distance from a start position of a frame of the high frequency component to an emerging start position of the wave signal. sine wave, and is to specify a frequency and initial position of emergence of the sine wave signal is fixed as a home position within the frame, and generate and output configured data from a low frequency signal as a low frequency component of the audio signal , envelope information, and sine wave information.
[0013]
13. Signal processing device, characterized in that it comprises: a low-frequency decoding unit that decodes a low-frequency signal as a low-frequency component of an audio signal; an envelope information decoding unit that decodes envelope information representing an envelope of a high frequency signal as a high frequency component of the audio signal; a sine wave information decoding unit which decodes sine wave information which includes information representing a distance from a start position of a high-frequency component frame to an emersion start position of a sine wave included in the high-frequency signal, and is for specifying a frequency and an emersion position of the sine wave; a pseudo high-frequency signal generating unit that generates a high-frequency pseudo-signal from the decoded low-frequency signal and the information. decoded envelope operation; a sine wave signal generating unit which generates a sine wave signal from the decoded sine wave information and in which the specified emersion home position of the sine wave information is set as a home position within a frame; and an audio signal generating unit that generates an audio signal emitted from the decoded low frequency signal, the high frequency pseudo signal, and the sine wave signal.
[0014]
14. Signal processing device according to claim 13, characterized in that the sine wave information is generated for each band configuring the high frequency component.
[0015]
15. Signal processing method for controlling a signal processing device, the signal processing device including a low-frequency decoding unit for decoding a low-frequency signal as a low-frequency component of an audio signal, a unit an envelope information decoding unit that decodes envelope information representing an envelope of a high frequency signal as a high frequency component of an audio signal; a sine wave information decoding unit configured to decode sine wave information that includes information representing a distance from a start position of a frame of the high-frequency component to an emerging start position of a sine wave included in the high-frequency signal, and is for specifying a frequency and emersion position of the sine wave signal; high frequency generating pseudounit to generate a high pseudo signal frequency of the decoded low-frequency signal and the decoded envelope information; a sine wave signal generating unit which generates a sine wave signal from the decoded sine wave information and in which the specified emerging initial position of the sine wave information is set as a start position within a frame, and an audio signal generating unit which generates an output audio signal from the decoded low frequency signal, the high frequency pseudo signal and the sine wave signal; the method characterized in that it comprises the steps of: decoding, using the low-frequency decoding unit, the low-frequency signal; decoding, using the envelope information decoding unit, the envelope information; decoding, using the unit decoding sine wave information, sine wave information; egenerate, using the high-frequency pseudo signal generation unit, the high-frequency pseudo signal; generate, using the sine wave signal generation unit, the sine wave signal; egenerate, using the audio signal unit, the output audio signal.
[0016]
16. A computer-readable storage medium, characterized in that it comprises instructions that, when executed by a processor, perform the steps of: decoding a low-frequency signal as a low-frequency component of an audio signal, decoding information of envelope representing an envelope of a high frequency signal as a high frequency component of an audio signal; decoding sine wave information which includes information representing a distance from a start position of a frame of the high frequency component to a start position of emersion of a sine wave, and is to specify a frequency and position of emersion of the sine wave signal; generate a high frequency pseudo signal from the decoded low frequency signal and the decoded envelope information; generate a sine wave signal from the decoded information sine wave decoded and in which the specified emergence initial position of the sine wave information is set as a home position within a frame, and generates an output audio signal from the decoded low frequency signal, the high frequency pseudo signal, and the sine wave signal.

类似技术:

---

公开号 | 公开日 | 专利标题

---

BR112013017427B1|2021-06-15|SIGNAL PROCESSING DEVICE, SIGNAL PROCESSING METHOD TO CONTROL A SIGNAL PROCESSING DEVICE, AND COMPUTER-READABLE STORAGE MEANS

---

RU2487428C2|2013-07-10|Apparatus and method for calculating number of spectral envelopes

---

JP6185457B2|2017-08-23|Efficient content classification and loudness estimation

---

RU2641461C2|2018-01-17|Audio encoder, audio decoder, method of providing coded audio information, method of providing decoded audio information, computer program and coded presentation using signal-adaptive bandwidth extension

---

JP5071479B2|2012-11-14|Encoding apparatus, encoding method, and encoding program

---

JP2017187790A|2017-10-12|Audio signal encoding method and device

---

JP2008513823A|2008-05-01|Joint audio coding to minimize perceptual distortion

---

TWI467979B|2015-01-01|Systems, methods, and apparatus for signal change detection

---

TWI585754B|2017-06-01|Decoder and method for generating a frequency enhanced audio signal, encoder and method for generating an encoded signal, and computer readable medium

---

PT2951814T|2017-07-25|Low-frequency emphasis for lpc-based coding in frequency domain

---

JP6286554B2|2018-02-28|Apparatus and method for decoding encoded audio signal using low computational resources

---

JP2004054156A|2004-02-19|Method and device for encoding sound signal

---

BR112015010954B1|2021-11-09|METHOD OF ENCODING AN AUDIO SIGNAL.

---

BRPI0910516B1|2021-12-28|LOW-RATE AUDIO ENCODING / DECODING SCHEME WITH A COMMON PRE-PROCESSING

---

BR112015018040B1|2022-01-18|LOW FREQUENCY EMPHASIS FOR LPC-BASED ENCODING IN FREQUENCY DOMAIN

---

BR112015018017B1|2022-01-25|DECODER FOR THE GENERATION OF AN AUDIO SIGNAL OF IMPROVED FREQUENCY, DECODING METHOD, ENCODER FOR THE GENERATION OF AN ENCODED SIGNAL AND ENCODING METHOD WITH COMPACT SELECTION SIDE INFORMATION

同族专利:

---

公开号 | 公开日

---

MX2013007895A|2013-08-27|

---

JP2012145895A|2012-08-02|

---

CN103314407B|2016-06-15|

---

MX345045B|2017-01-16|

---

CA2820195C|2021-05-25|

---

EP3849087A1|2021-07-14|

---

US10431229B2|2019-10-01|

---

KR101975066B1|2019-05-03|

---

RU2013130742A|2015-01-10|

---

AU2012206122A1|2013-07-04|

---

BR112013017427A2|2016-09-27|

---

KR20130141634A|2013-12-26|

---

US20170148452A1|2017-05-25|

---

EP2665061A4|2016-12-14|

---

KR102048672B1|2019-11-25|

---

KR20190047114A|2019-05-07|

---

US20190355368A1|2019-11-21|

---

AU2012206122B2|2017-04-20|

---

US10643630B2|2020-05-05|

---

TW201230012A|2012-07-16|

---

RU2604338C2|2016-12-10|

---

EP2665061A1|2013-11-20|

---

CA2820195A1|2012-07-19|

---

KR20190095530A|2019-08-14|

---

JP5743137B2|2015-07-01|

---

US20130275142A1|2013-10-17|

---

TWI498885B|2015-09-01|

---

EP2665061B1|2021-03-03|

---

KR102010220B1|2019-08-12|

---

CN103314407A|2013-09-18|

---

WO2012096230A1|2012-07-19|

引用文献:

---

公开号 | 申请日 | 公开日 | 申请人 | 专利标题

---

---

RU2049456C1|1993-06-22|1995-12-10|Вячеслав Алексеевич Сапрыкин|Method for transmitting vocal signals|

---

SE512719C2|1997-06-10|2000-05-02|Lars Gustaf Liljeryd|A method and apparatus for reducing data flow based on harmonic bandwidth expansion|

---

US6266644B1|1998-09-26|2001-07-24|Liquid Audio, Inc.|Audio encoding apparatus and methods|

---

JP2003515776A|1999-12-01|2003-05-07|コーニンクレッカフィリップスエレクトロニクスエヌヴィ|Method and system for encoding and decoding audio signals|

---

WO2002053550A1|2000-12-27|2002-07-11|Pola Chemical Industries, Inc.|Benzofuran derivatives and pharmaceutical compositions containing the same|

---

JP3870193B2|2001-11-29|2007-01-17|コーディングテクノロジーズアクチボラゲット|Encoder, decoder, method and computer program used for high frequency reconstruction|

---

US20050228648A1|2002-04-22|2005-10-13|Ari Heikkinen|Method and device for obtaining parameters for parametric speech coding of frames|

---

JP4313993B2|2002-07-19|2009-08-12|パナソニック株式会社|Audio decoding apparatus and audio decoding method|

---

KR100723753B1|2002-08-01|2007-05-30|마츠시타 덴끼 산교 가부시키가이샤|Audio decoding apparatus and audio decoding method based on spectral band replication|

---

JP3861770B2|2002-08-21|2006-12-20|ソニー株式会社|Signal encoding apparatus and method, signal decoding apparatus and method, program, and recording medium|

---

CN100492492C|2002-09-19|2009-05-27|松下电器产业株式会社|Audio decoding apparatus and method|

---

CA2457988A1|2004-02-18|2005-08-18|Voiceage Corporation|Methods and devices for audio compression based on acelp/tcx coding and multi-rate lattice vector quantization|

---

KR20070001185A|2004-03-17|2007-01-03|코닌클리케 필립스 일렉트로닉스 엔.브이.|Audio coding|

---

JP5224017B2|2005-01-11|2013-07-03|日本電気株式会社|Audio encoding apparatus, audio encoding method, and audio encoding program|

---

TWI319565B|2005-04-01|2010-01-11|Qualcomm Inc|Methods, and apparatus for generating highband excitation signal|

---

US7548853B2|2005-06-17|2009-06-16|Shmunk Dmitry V|Scalable compressed audio bit stream and codec using a hierarchical filterbank and multichannel joint coding|

---

KR100684029B1|2005-09-13|2007-02-20|엘지전자 주식회사|Method for generating harmonics using fourier transform and apparatus thereof, method for generating harmonics by down-sampling and apparatus thereof and method for enhancing sound and apparatus thereof|

---

KR100958144B1|2005-11-04|2010-05-18|노키아 코포레이션|Audio Compression|

---

JP4736812B2|2006-01-13|2011-07-27|ソニー株式会社|Signal encoding apparatus and method, signal decoding apparatus and method, program, and recording medium|

---

US7775528B2|2006-02-13|2010-08-17|Freudenberg-Nok General Partnership|Bi-directional pattern for dynamic seals|

---

US8041578B2|2006-10-18|2011-10-18|Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V.|Encoding an information signal|

---

JP4918841B2|2006-10-23|2012-04-18|富士通株式会社|Encoding system|

---

KR101149449B1|2007-03-20|2012-05-25|삼성전자주식회사|Method and apparatus for encoding audio signal, and method and apparatus for decoding audio signal|

---

CN101896967A|2007-11-06|2010-11-24|诺基亚公司|An encoder|

---

EP2104096B1|2008-03-20|2020-05-06|Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.|Apparatus and method for converting an audio signal into a parameterized representation, apparatus and method for modifying a parameterized representation, apparatus and method for synthesizing a parameterized representation of an audio signal|

---

US8725502B2|2008-06-05|2014-05-13|Qualcomm Incorporated|System and method of an in-band modem for data communications over digital wireless communication networks|

---

EP2352147B9|2008-07-11|2014-04-23|Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.|An apparatus and a method for encoding an audio signal|

---

AU2009267530A1|2008-07-11|2010-01-14|Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V.|An apparatus and a method for generating bandwidth extension output data|

---

JP2010079275A|2008-08-29|2010-04-08|Sony Corp|Device and method for expanding frequency band, device and method for encoding, device and method for decoding, and program|

---

US8380498B2|2008-09-06|2013-02-19|GH Innovation, Inc.|Temporal envelope coding of energy attack signal by using attack point location|

---

CA2966469C|2009-01-28|2020-05-05|Dolby International Ab|Improved harmonic transposition|

---

JP5754899B2|2009-10-07|2015-07-29|ソニー株式会社|Decoding apparatus and method, and program|

---

JP5652658B2|2010-04-13|2015-01-14|ソニー株式会社|Signal processing apparatus and method, encoding apparatus and method, decoding apparatus and method, and program|

---

JP5609737B2|2010-04-13|2014-10-22|ソニー株式会社|Signal processing apparatus and method, encoding apparatus and method, decoding apparatus and method, and program|

---

JP5850216B2|2010-04-13|2016-02-03|ソニー株式会社|Signal processing apparatus and method, encoding apparatus and method, decoding apparatus and method, and program|

---

JP6075743B2|2010-08-03|2017-02-08|ソニー株式会社|Signal processing apparatus and method, and program|

---

JP5707842B2|2010-10-15|2015-04-30|ソニー株式会社|Encoding apparatus and method, decoding apparatus and method, and program|

---

JP5743137B2|2011-01-14|2015-07-01|ソニー株式会社|Signal processing apparatus and method, and program|

---

JP5704397B2|2011-03-31|2015-04-22|ソニー株式会社|Encoding apparatus and method, and program|

---

JP6037156B2|2011-08-24|2016-11-30|ソニー株式会社|Encoding apparatus and method, and program|

---

JP5942358B2|2011-08-24|2016-06-29|ソニー株式会社|Encoding apparatus and method, decoding apparatus and method, and program|

---

JP5975243B2|2011-08-24|2016-08-23|ソニー株式会社|Encoding apparatus and method, and program|

---

JP5845760B2|2011-09-15|2016-01-20|ソニー株式会社|Audio processing apparatus and method, and program|

---

JPWO2013154027A1|2012-04-13|2015-12-17|ソニー株式会社|Decoding device and method, audio signal processing device and method, and program|

---

AU2013284705B2|2012-07-02|2018-11-29|Sony Corporation|Decoding device and method, encoding device and method, and program|

---

US9437198B2|2012-07-02|2016-09-06|Sony Corporation|Decoding device, decoding method, encoding device, encoding method, and program|

---

TWI517142B|2012-07-02|2016-01-11|Sony Corp|Audio decoding apparatus and method, audio coding apparatus and method, and program|

---

RU2649944C2|2012-07-02|2018-04-05|Сони Корпорейшн|Decoding device, decoding method, coding device, coding method and program|

---

JP2014123011A|2012-12-21|2014-07-03|Sony Corp|Noise detector, method, and program|

---

EP3048609A4|2013-09-19|2017-05-03|Sony Corporation|Encoding device and method, decoding device and method, and program|

---

AU2014371411A1|2013-12-27|2016-06-23|Sony Corporation|Decoding device, method, and program|JP5754899B2|2009-10-07|2015-07-29|ソニー株式会社|Decoding apparatus and method, and program|

---

JP5609737B2|2010-04-13|2014-10-22|ソニー株式会社|Signal processing apparatus and method, encoding apparatus and method, decoding apparatus and method, and program|

---

JP5850216B2|2010-04-13|2016-02-03|ソニー株式会社|Signal processing apparatus and method, encoding apparatus and method, decoding apparatus and method, and program|

---

JP6075743B2|2010-08-03|2017-02-08|ソニー株式会社|Signal processing apparatus and method, and program|

---

JP5707842B2|2010-10-15|2015-04-30|ソニー株式会社|Encoding apparatus and method, decoding apparatus and method, and program|

---

JP5743137B2|2011-01-14|2015-07-01|ソニー株式会社|Signal processing apparatus and method, and program|

---

JP6037156B2|2011-08-24|2016-11-30|ソニー株式会社|Encoding apparatus and method, and program|

---

TWI517142B|2012-07-02|2016-01-11|Sony Corp|Audio decoding apparatus and method, audio coding apparatus and method, and program|

---

RU2649944C2|2012-07-02|2018-04-05|Сони Корпорейшн|Decoding device, decoding method, coding device, coding method and program|

---

AU2013284705B2|2012-07-02|2018-11-29|Sony Corporation|Decoding device and method, encoding device and method, and program|

---

US9437198B2|2012-07-02|2016-09-06|Sony Corporation|Decoding device, decoding method, encoding device, encoding method, and program|

---

JP6284298B2|2012-11-30|2018-02-28|Kddi株式会社|Speech synthesis apparatus, speech synthesis method, and speech synthesis program|

---

CN104584124B|2013-01-22|2019-04-16|松下电器产业株式会社|Code device, decoding apparatus, coding method and coding/decoding method|

---

JP6239007B2|2013-01-29|2017-11-29|フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン|Audio encoder, audio decoder, method for generating encoded audio information, method for generating decoded audio information, computer program and coded representation using signal adaptive bandwidth extension|

---

US9666202B2|2013-09-10|2017-05-30|Huawei Technologies Co., Ltd.|Adaptive bandwidth extension and apparatus for the same|

---

EP3048609A4|2013-09-19|2017-05-03|Sony Corporation|Encoding device and method, decoding device and method, and program|

---

CN104517610B|2013-09-26|2018-03-06|华为技术有限公司|The method and device of bandspreading|

---

US9858941B2|2013-11-22|2018-01-02|Qualcomm Incorporated|Selective phase compensation in high band coding of an audio signal|

---

AU2014371411A1|2013-12-27|2016-06-23|Sony Corporation|Decoding device, method, and program|

---

JP6603414B2|2016-02-17|2019-11-06|フラウンホファーゲセルシャフトツールフェールデルンクダーアンゲヴァンテンフォルシュンクエー．ファオ．|Post-processor, pre-processor, audio encoder, audio decoder, and related methods for enhancing transient processing|

---

JP6769299B2|2016-12-27|2020-10-14|富士通株式会社|Audio coding device and audio coding method|

---

US10896684B2|2017-07-28|2021-01-19|Fujitsu Limited|Audio encoding apparatus and audio encoding method|

法律状态:
2018-12-18| B06F| Objections, documents and/or translations needed after an examination request according [chapter 6.6 patent gazette]|

---

2019-09-17| B06U| Preliminary requirement: requests with searches performed by other patent offices: procedure suspended [chapter 6.21 patent gazette]|

---

2020-12-15| B06A| Notification to applicant to reply to the report for non-patentability or inadequacy of the application [chapter 6.1 patent gazette]|

---

2021-04-06| B09A| Decision: intention to grant [chapter 9.1 patent gazette]|

---

2021-06-15| B16A| Patent or certificate of addition of invention granted|Free format text: PRAZO DE VALIDADE: 20 (VINTE) ANOS CONTADOS A PARTIR DE 06/01/2012, OBSERVADAS AS CONDICOES LEGAIS. |

优先权:

---

申请号 | 申请日 | 专利标题

---

JP2011-006233|2011-01-14|

---

JP2011006233A|JP5743137B2|2011-01-14|2011-01-14|Signal processing apparatus and method, and program|

---

PCT/JP2012/050173|WO2012096230A1|2011-01-14|2012-01-06|Signal processing device, method and program|

---